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An evaluation was conducted of the second year of 
Proiect REAL (Relevant Experiences for Alternative Learning) , which 
provides hiah school students in Newark, Delaware, with 
com'munity-bd- 5d career development experiences and relates these 
learninq activities to the curriculum of life skills, basic skills, 
and career development. In the area of student outcomes it was found 
that students did not improve in basic skills or career 
decision-making and employment-seeking skills after participating in 
the proiect. Nevertheless, learning managers and commuuity 
instructors rated the students high in personal employment and 
career -related dimensions. In the category of student process goals 
and obiectives, the project has been successful in its placement of 
students in diverse community work sites, implementation of a 
comprehensive student assessment system, instruction in dealing with 
sex bias and discrimination, and award of credit for proiect 
participation. The project has also fulfilled its proposed management 
process tasks: developing and implementing manaqement and staff 
development plans, obtaininq parental permission for student 
participation, providinq insurance for participants, and establishing 
a proiect advisory board- Recommendations were made for improvements 
in the three evaluated areas. (The appen.iixes contain the evaluation 
plan and a checklist of essential characteristics for implementation 
sites. ) (^LG) 
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SFXTTON I. INTRODUCTION 
The Newark (DE) School District has been awarded a three-year contract 
from the U.S. Office of Education to implement an experience-based career 
education project subsequently referred to as Project REAL Releva\it 
Experiences for Alternative Learning. As part of the terms and conditions 
of the contract Educational Testing Service (ETS) has been selected to 
provide third-party evaluation services for the project's second year of 
operation — November 1, 1977 to October 31, 1978. ETS's specifications 
for the third-party evaluation wt^re included as part of Newark's original 
proposal to the Office of Education* ETS received a formal letter of 
agreement (contract) from thp district to provide these services on 
November 30, 1977, 

Experlence-B.. ed. Caree.r_Jiduj^.j,on^ 

Experience-Bcused Career Education (FRCE) was concep tua 1 i Zf»d and Initiated 
tlirou^h rhe r.S. Office of Education. Following. pnMiminnrv t^xp 1 or .it orv 
'ntudles, four rf^glrnial 1 ahorai I'jr 1 es woro r^t^lvct^d bv iht' Natlcmal liisri- 
^'ite ot !'■:^^u(^^t 1 on ^NI^\) to d(^vpl<^p tin-' K!V^ .onot^pt Into an alternative^ 
.Mlvi'^if f onn 1 prot>r;in tor ^\UKh who'^1 ^tu^iont^;. ''l-** *:*'wirl.' Mi^.t. ritt 



selected Northwest Regional Educational Laboratories EBCE project for 
implementation In the district. Northwest^s EBCE project has essentially 
three broad characteristics: 

1* The project is student-centered and stresses 
personalized learning experiences for partici- 
pating students- 

2. The focus of student learning processes is 
comnmnity based • 

3. Instructional experiences of an academic nature 

are integrated with career development experiences-^ 
The curriculum content for Project REAL is individualized on the 
basis of each student's unique cognitive style, personal goals and 
educational needs. Project staff are guided in the development and 
preparation of individual student learning plans by the following major 
curriculum components: 
T. Life Skills 

• Creative development 

• Critical thinking 

• Personal /social development 

• Science 

• Functional citizenship 
r I . B asic Skill s 

• Reading 

• Written and verbal o.xpressi'-^n 

• Mathematics 



1, National Institute of Education, F.ducatlnn and Work Prnc;r an (M* 'OH!:*; , 
A Compar ison of Four Ex perience-B.ise_d Caref^^^^^ .]'JLCilL''''jriS , I " • 
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TII* Career Developmen t 



Career knowledge and interests 
Etnployability skills 
World of Work^ 



Project REAL Goals 

The goals of Project REAL as contained in the proposal to the U.S. 
Office of Education are: 

Goal A: Providing the overall management and support staff 
for the program 

Als Establishing an advisory board to function in the areas 
of program planning, governance and community relations 

A2: Developing a management plan for each year of operation 
Goal B: Developing the necessary instructional and curriculum 

materials for approximately 60 students for the first year 
of operation 

Establishing a network of community sites in which 
st\ident learning activities will take place 
Implementing EBCE curriculum materials in three high 
schools that relate community learning activities with the 
three program context areas: Life Skills, Basic Skills and 
Career Development 
Goal C: Evaluating student process and student outcome data 
Clt Developing and implementing an evaluation design that 

provides for student outcome evaluation, process evaluation, 
summative evaluation and side effects evaluation 
Goal D: Developing alternative strategies for demonstrating 

and disseminating Project REAL mat rials through Delaware 
Dl. : Providing consultant >^ervices and appropriate materials 

to districts intnrestod in implementing Project RF.AL 
n:: Providing dissemination of Proje.Lt REAL infornation through 
^^rnduate career and vocational education courses offeree! 
at the University nf Dp lawart? . ' 
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1. Newark, Delaware, ?LlXaEj2Mi-Jl^^--^l£--i-^^^ 
Rp^i_pn;i 1_ jyjAr:ltJi:m_.jyi]?n rat£^ 19 76. 
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During Project REAL'S first year of operation 34 students were 
Involved in the project in Christiana, Glasgow and Newark High Schools. 
This increased by approximately 100 percent in the second year of opera- 
tion (N=70) . 

Background of the District 

Newark, Delaware is located midway between the nation's capitol and 
New York City. The city has experienced sizeable growth in industry 
and housing. It has progressed from a small farming community to one 
presently characterized by the problems, and attendant demand for 
expanded services typical of cities in the northeast megalopolis. 
The Newark School District's student enrollm.ent has drubled every five 
years since World War II until 1975 and is currently esti-iiated at 17,000 
students. The district encompassed about 15 percent of the state of 
Delaware's total population. The Newark District is heterogenous in its 
occupational and sociocultural makeup with middle-income families pre- 
dominating. A high proportion of the district's workers are employed In 
two broad areas; production and scientific-technical. 

Court mandated desegregation and district reorganization during 
Project real's second year of operation (school year 1977-78) brought 
about significant changes to the Newark School District. The most 
significant impact was the reassignment of Project REAL'S director 
to a post under the direction of Newark's super i nt (?nd(^nt . Frc^m 
f^-wi nt or of 1/^"^ until e.^rlv Spring', .ipp r*^^!^;^ e 1 y hAlf nt 



director's time was spent in the preparation of district reorganization 
plans. During the remainder of the school year the director was reassigned 
(full-time) to the position of administrative principal of Christiana 
Middle School. Although this reassignment did not appear to seriously 
alter the operation of Project REAL, the administrative vacuum that this 
reassignment caused may have had unknown effectia on Project REAL- 

Scope of Evaluation 

The evaluation plan for Project REAI/s second year of implementation 

is found in Appendix A-and includes evaluative questions that are intended 

to determine the extent to which: 

(1) Project REAL has been implemented in .accordance 
with its proposal . 

(2) Student process objectives and product outcomes 
have been attained- 

(3^ Assurances specified by the U.S. Office of Education 
have been achieved* 

The evaluation plan was prepared in three parts. Part A of the 
plan lists evaluative questions related to student outcom*?s; Part B 
contains questions about student process objectives; and Part C specifies 
questions related to project management tasks- Specifically the format 
of the plan is as follows: 

• Evaluation Questi ons : A description of the topical 
arpa to bp evaluated in three broad categories: 
Part A - Student Outcome rlva hi at ion Quest ions 
?Art B - S tiKien t Prncf.>5;s Eva liiat ion Ones t i ons 
Part ^- ^- Manaeernent Proct^ss Tv? la;?t i on Ouof; i i c n^? 
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• Data Source ! Lists data sources that will be used to 
provide information about each evaluation question 

• Time Data Collected: Data conectlon time frame by 
Fall, Winter or Spring 

• E valuation Design ; Specific type of design to be used; e.g% 
-Formative 

-Sumtnatlve 

-Pretest/Posttest ; Posttest Onl) 

• Analysis : Description of the type of analysis to be used, 
such as norm group comparison, analysis of variance or 
covarlance and so on. 

• Target Criteria : A description of the criteria or standards 
to be used to assess whether the evaluation question has 
been answered in the desired direction. 

• Sample : The sample (or population) subjects or documents 
to be employed as basis for analysis. 

The subsequent sections of the Final Evaluation Report present 
discussion of the finding of Project REAL's second annual evaluation. 
The sections are presented consistent with the major parts of the eval- 
uation design* 
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SECTION IT . PROvJECT REAI. STUDENT OUTCOME EVALUATION QUESTIONS 

A . Have Project REAL Students Maintained Th eir Performance Level in the 
Basic Skill Areas ? 

The basic premise of Project REAL Is that project students will perform 
in the basic sklU areas as well as students enrolled in traditional high 
school programs. Analysis of the data collected indicates that student 
performance decreased in al basic skill areas measured. 

The California Test of Basic Skills (CTBS) was administered to 
all project students employing a pretest-post test design* Assessment of 
student performance was determined using the CTBS national norming sample 
as the comparison group. Also, matched t-^tests were computed between the 
experimental groups pretest-pos ttest mean scores. Mean scores, standard 
deviations, and t-values are displayed in Table 1. The data reveals that 
for each of the basic skill areas measured, the posttest mean score 
was lower than the pretest's mean score. Posttest mean scores were 
■significantly lower than pretest mean scores in reading (p» < .05), 
mathematics (p* < -01) and reference skills (p* < *0l)* 

Table 2 , 3 , an A display the results of analyses betyeen pretest- 
posttest moan scores within each of the project schools; Newark, Christia 

Glasgow High Schools. These data reveal an overall trend in poorer 
performance on posttefst measures than pretest measures within each of 
the project school^]. 



Table 1 



CTBS Pretest-Posttest Scores for Project REAL 



Pretest 



Posttest 



Table 2 

CSAP and CTBS Prates t-Posttest Scores for 
Project REAI., Newark High School 



Pretest 



Po£3t test 



* 



P ' 
P • 



<- .05 
<' .01 
< .001 
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Reading 
Language 
Mathematics 
Reference Skills 



N 




SD 


X 


SD 


t-value 


30 


63.90 


15.00 


57.07 


19.11 


-2.08* 


29 


61. -il 


11.58 


56.24 


17.28 


-1.89 


29 


68.35 


18.12 


57 .59 


24.19 


-3.14** 


30 


15.70 


3.09 


12.37 


5.36 


-3.87** 





N 


X 


SD 


X 




t-value 


Reading 


14 


68.07 


14,14 


57.64 


20. 15 


-1.73 


Language 


13 


65.62 


10.63 


57.54 


21 .37 


- I . b 3 


Mathematics 


13 


72 .15 


14 .38 


60.31 


24.7 5 


-1.8 3 


Reference Skills 


14 


16,43 


2.14 


12 .00 


5.8 2 


-3.35** 


Career Decision Making 


13 


44.92 


10.93 


50.00 


8. 39 


2.09* 


Employment Seeking Skills 


13 


36.39 


6.48 


55.77 


15.73 


-0.16 
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Table 3 



CSAP and CTBS Pretest-Posttest Scores i 
Project REAL, Christiana High School 



or 



Pretest 



Postteat 



Reading 
Language 
Mathematics 
Ref. Skills 

Career Decision Making 
Fmployment Seeking Skills 



N 

11 
11 

11 
11 
12 
11 



62.27 
57.27 
66.64 
15.81 
42,75 
54.91 



SD 

14.11 
11,66 
22.70 

2.99 
11.80 

5,58 



59.46 
56.64 
53.36 
12.91 
14.33 
54.64 



SD 



17.07 
11.17 
25.28 
5 

10.92 
11.61 



■.V 



t-v alue 

-0.62 
-0.66 
-2.92** 
-1.82 
0.26 
-0.09 



Table 4 

CSAP and CTBS Pretest-Posttest Scores for 
Project REAL, Glasgow High School 



Pretest 



Postti'st 





N 


X 


SD 


X 




SD 


t-value 


Head 1 ng 


5 


55.80 


18.30 


50.20 


on 


.90 


-2.37 


Laftguagfi 


5 


55.20 


11.93 


52.00 


19 


.51 


-0.78 


Mathematics 


5 


62.20 


17.01 


59.80 


24 


.11 


-0.65 


Ref. Skills 


5 


13.40 


4.83 


12.20 


5 


.07 


-2.06 


Career Decision Making 


5 


41.33 


10.02 


44.67 


13 


.58 


1.28 


'•'mp lovtnent Seeking Skills 


5 


54.50 


9.11 


54.00 


14 


.02 


-0 . 1 8 
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B t Have Project REAL Students Increased Their Career Dec! sion-Making 
Skills? 

The Career Skills Assessip^cnt Program (CS/lP) career decision-making 
skills and employment seeking skills measures were administered on a 
pretes t-posttest basis to all project students and a non-equivalent 
Intact comparison group. The comparison group was randomly selected 
within each o£ the project schools o CSAP measures are designed for 
secondary school students and were ndmlnisterad to both groups in 
October, 1977 and May, 1978* 

Table 5 displays mean pretest and posttest scores, standard 
deviations and F-tests for project and comparison students. As revealed 
In this table, there was a significant difference (p. < -05) between 
pretest mean scores on the career decision making skills measure. 
Project REAL students scored significantly higher than the comparison 
group. There was however, no significant difference between the groups 
mean posttest scores. 

Tables 2, 3, and A on the previous page shows the results of 
matched t-tests for Project REAI. students only in oach of the project 
schools. Although there were no significant differences in two of the 
schools, Newark High School project students Increased a significant 
amotmt between pretes t-posttest (p. < .05) in Che area of career decision 
m<ikln^ « 

Table 6 llsplays and unweighted means analysis of variance for 
r.\rei^T dec i si on-maklnt^ skills posttest: scores adjusted for pretest 
qr(>rpq. The data reveals no t n c i 5? 1 1 ca Ily significant difference between 
''rolect PF-^^r =?tndt-nrs and the comparl<:?on ^^rcMip* '^lien differences between 
r.e;^n r^retest ^rnren f^.^^r Projert RMAI. students .ind the roT^.^arlson ^roup 
were arfv.nmted for, rherp was r\o i '.:n 1 f 1 cant .llrference on nean pt^sttest 

r < » r P . 

7 
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C . Have Project REAL Students Increased Their ETuplovnient Seeking Skills ? 
The CSAP employment seeking skills measure was administered to Project 
REAI. students as the comparison group in October, 1977 and May, 1978 - 
As Illustrated in Table 5, there were no significant differences 
between both groups mean pretest and posttest scores on the employment 
seeking skills measure. 

Table 5 

CSAP Pretest-Posttest Scores for Project REAL 
and Compari&on Group 

Pretest Posttest 





Group 


N 




X 


SD 


f- 


test 


N 


X 


ID 


F-test 


Career Decision 


E 


55 


AO 


.91 


11.62 


1 . 


6 3* 


38 


A5.03 


11. A7 


1.25 


Making Skills 


C 


125 


33 


.18 


U.8A 






66 


AA.06 


12.83 




Employment Seeking 


E 


55 


5A 


.A9 


7.61 


3. 


21 


38 


53.63 


13.27 


1.21 


Skills 


C 


130 


hi 


.02 


13.63 






70 


55. 3A 


12 .04 





Table 6 

Unweighted Means Analysis of Variance for CSAP Career 
Decision Making Skills Posttest Adjusted for Pretest 



Source 


Sum of Squares 


OF 


Mean Square 


F 


Significance 


Project REAL/Comparison 


0.32 


1 


0.320 


O.OOA 


p = 0.9A8 


Covariates 


3991 .22 


1 


3991.22 


32.52 


p =■ 0.000*** 


Exp lained 


3991. 5A 




1995.77 


26 .26 


p = 0.000*** 


Res idual 


658A.10 


8 A 


76.00 






Total 


L0375.6A 


86 


120.6 5 










Table 
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Unweighted Means Analysis of Variance for CSAP Flm^:) loyment 
Seekinj^ Skills Posttest Adjusted for Preterit 



Soiirc e 


Sum of Squares 


DF 


Mean Sq^uar i^.s F 


Sic^,nit"icancp 


Project R F AI. / C nmp n r 1 y-> on 


36-^0 


1 


36.60 0.30 


P " 


0.584 


Covariates 


3250.31 


] 


3250 *31 2^^- / 


P ' 




Flxp lained 


3286.90 




] hA3 .^'^'-^ 1 3 


V = 


r 0,000*** 


Res Idual 












Tot a L 




"JO 









** p. ^ .01 
*** p. ' ,001 
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The results of matched t-tests for Project REM. students only on 
the employment seeking skills measure displayed In Tables 2, 3, and 4 
show no significant differences between pretest and posttest me.an scores. 
However, posttest mean scores within each of the project scores were 
slightly lower than mean pretest scores. 

Table 7 displays an unweighted means analysis of variance for 
employment-seeking 'ski lis posttest scores adjusted for pretest scores* 
The data indicates no significant difference between Project REAL students 
and the comparison group. When differences between mean pretest scores 
for both groups were accounted for, there was no significant difference 
between Project REAL students and the comparison group. 

D . What Are the Opinions of Project REAL Learning Managers and Commu nity 
Instructors About Project Students ? 

Project REAL learning managers and community instructors uniformly 

expressed high opinions about personal and career development attributes 

of project students. When asked to rate students on specific career and 

personal development attributes, Table 8 illustrates that Project REAL 

learning managers consistently reported that students demonstrated positive 

employment related attitudes and a desire to apply the knowledge cind 

skills learned in the area of career development • 

Please note that statement 13, lA, and 15 in the questionnaire 

.ire stated negaMvely; therefore the mean scorur^ of 4,^.3, :.ind *.n 

respect ivt^ly Indicate relatively posit ive perf ormnncr-^ . 




As illustrated In Table 9, community instructors Indicated that students 
are not disruptive on the job, take Initiative In taking on a project, 
ask questions when a problem occurs, and take pride in their work» 
Community instructors responses to item number eight indicates consistent 
agreement among the community. These data indicate that project students 
do not resent receiving directions on the work-site. 

One-hundred percent of the community instructors surveyed indicated 
they would recommend that other employers become involved in Project 
REAL. Furthermore, slightly more than 70 percent reported that all 
students should participate in Project REAL regardless of their career or 
educational plans with 26 percent reporting that only those students 
whose career or educational plans are uncertain should participate. Only 
3.6 percent responded by indicating that Project REAL should only be for 
those students who expect to get a job immediately after high school 
graduation. 



Table 8 



PROJECT REAI. LEARNING MANAGERS RATING SCAI.E 



3 

5 

7 
8 
Q 

10 



1 1 



1 



This describes 
the student 
perfect ly 



This is true 
most of the 
time 



Sometimes this 
is true of the 
student 



This is not 
usually so 



Pays attention to good grooming and dresses appropriately 
for cotmniinlty site. 

Shows responsibility in completing assigned tasks. 

Is punctual and meets deadlines- 

Shows an interest in learning about careers. 

Relates abilities, values, and needs to career options. 

Relates level of education required to career options. 

Uses appropriate resources to gather career information. 

Is cooperative and willing to listen to advice. 

FollovR required project procedures and policies. 

Applies decision-making skills in the selection of 
career opport unl t ies • 

Makes realistic plans about: future career goals. 

I.s motivated tn want to work nnd expend effort. 

Shows di f f 1 c\x 1 1 V In romimml cat 1 n>7, wl th .idti 1 1 ? mi t!ie 
r. 1 ephone . 

Ron ri Ires rlt^s*^ supt^rvl ?^ i .^n • 



The student 
is not like 
this at all 



1.96 

2.33 

2. AO 
2.02 
] .98 
2.02 
2.07 
1 .89 
2.20 

:.io 

2.20 

- . ! ^ * 



in 

.77 

1.04 
1.07 
1.00 
,94 
.87 
.9A 
.94 
1.01 
.94 

1 .01 
1.10 
1 .00 

1 . 50 

1 1 « 



I ' res ! ii'i ' . 1 1 <• r >' . ,u 1 vt 
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Table 9 

PROJECT REAL COhfMlINlTY INSTRUCTORS PATINC SCALE 



1 

This describes 
the student 
perfect ly 



Thife is true 
most of the 
time 



3 

SometimeB this 
is true of the 
student 



This is not 
usually so 



The student 
is not like 
this at all 



1. Shows some initiative in taking on a pro ject • 

2» Can't get to community site on time* 

3. Shows interest in learning more about the career or 
occupation • 

A* Asks questions if problems come up. 

5. Is often absent from the comrtiunlty site* 

6. Has tr^ be told what to do every minute or can't keep busy 

7r Shows some pride In their work and doesn't just rush 
through to get it finished. 



1- 93 

4.49"^ 

1.67 
1.41 
4.70^ 
4.00^ 

2- 07 
5.00^ 



4.41 
1,48 



1 



8. Resents receiving directions from community instructor. 

9. Wastes time on the community site. 
10. Dresses appropriately for community work site. 
11* V^ould you recommend that other employers become Involved In Project REAL? 

_Jj0Ol Ye ft N«2 7 

No 



SD 
1.11 
.80 

.96 
.75 
.54 
1.33 

1.30 
.00 
1.01 
.80 



12. If sufficient community sites were available, would you recommend that all 
students participate In project REAL? 

70% Yes, all students should participate in Project REAL regardless 
of their career or educational plans. 

2^>'^ _ N'o, only thoRP students whose career or educational plans are 
uncertain • 

i*-^ No, only those students who expect to .Ret a job Imms^dlately after 

hi 5?.h school gradunt; 1 on . 
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1. Stated ne^atlvelv. The hi^h mea^i scnrei^ Indicate relatively positive 
pf*rf nrma nee* . 



F indings ; 

The findings of Project REAL's student outcome evaluation are: 

1. Project REAL students mean posttest scores were less than their 
mean pretest scores in each of the following basic skills areas: 

1.1 Reading 

1*2 Language 

1 . 3 Mathematics 

1.4 Reference Skills 

2. Project REAL students did not obtain statistically significant 
results when contrasted to a non-equivalent iutact comparison 
group in the following areas: 

2.1 Career Decision-Making Skills 

2.2 Employment Seeking Skills 

3. Project REAL Learning Manager uniformly held high opinion of 
project students on a variety of personal, employment and career 
related dimensions. 

4. Community Instructors consistently have high opinions of Project 
REAL students employment and career related dimensions. 

5i One-hundred percent of the community instructors surveyed 

recommended that other employers become involved in Project REAL 
with 70 percent responding that all students should become 
Involved in the project. 
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Conclusions^ 

1. Project REAL students did noc obtain the anticipated level 
of performance in all the basic skill areas measured when 
compared to a national norming population. 

2. Project REAI^ student performance in the areas of career 
decision-making skills and employment seeking skills was 
comparable to the performance of the comparison group. 

3. Learning managers and community instructors consistently 
rated Project REAL students high on a variety of personal, 
employment and career related dimensions . 

General conclusions about the impact of Project REAL on students 
in the basic skills and career education areas must be weighed carefully 
in regard to the organizational and educational climate in the Newark 
School District during the latter half of the school year. 

Reactions to court-ordered district reorgnlzat ion and desegregation 
plans were apparent in student boycotts and other general disruptions 
to normal school operations, staff uncertainty about teaching assignments 
and feelings of concern about future organizational patterns. Although 
the district appeared to be operating as It had in the past, uncertainty 
about the future of the district was perceived by students and staff 
alike. Ultimately, the anxiety associated with this situation was one of 
the underlying factors that precipitated a six week teacher strike In 
thp Fall, 1978. 

Thus, conclusions about the impact of Project REAL on students 
mist be viewed Judiciously. Tlie unknown circumstiances surrounding 
reorganization and dejsegregat ion plans may have Influenced instructional 
activities and test results in varylnj^ wavs and unknown amounts* 
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Recommendations 

The following are the recommend/- Ions for this section of the evaluation 
report j 

1. Attention should be directed at facilitating the assimilation 

of project REAL into the emerging reorganizatlonal pattern while 
maintaining the alternative educational structure of Project 
REAL. 

2. Attention should be directed at identifying specific content areas 
of the student assessment program in which students tended to 
perform less than anticipated. 

3. Based on the results of the previous analyses, instructional 
modules should be prepared and implemented by Project REAL's 
staff in each of these content areas. 
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SECTION III. PROJECT REAL STUDENT PROCESS EVALUATION QUESTIONS 

A . Have Project REAL Students Seen Placed in Community Exploratory and 
Project Learning Activities ? 

Project REAL program specifications require that students complete at 



least three exploratory experiences and five projects. Career exploratory 
experiences are three-to-five days In length during which time students 
Interact with adult members of the work force in occupations of Interest. 
Projects are longer in length, typically spanning three to five weeks and 
provide the opportunity for students to study occupations of particular 
Interest i:o them in depth. Projects are individualized and Incorporate 
academic as well as occupatlonally related areas. Both exploratory and 
project experiences are characterized by direct student contact with the 
tools, materials and other resources commonly found in community worksites* 

The data collected from Christiana, Glasgow and Newark High Schools 
Indicated that students achieved the target criteria set for the 
completion of exploratory and project experiences. Table 10 displays 
the number of students attaining the target criteria. 



Table 10 



Number of Students Attaining Criteria for Completion 
of Exploratory and Project Activities 



Project Sites 



Explor atory Experiences 



Project Experiences 



Christiana HS 
Glasgow HS 
Newark HS 



20 
10 
38 



18 
10 

36 



Total 
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Project REAL students participated in community experiences in a 
broad array of jobs or job clusters- Table 12 presents the number of 
students completing career explorations and projects in each of the 
following job clusters: 

Table 11 

Distribution of Project REAL Students in Job Clusters^ 



job Cluster N St udents 

1. Agrl-Business and Natural Resources A 

2. Business and Office 20 

3. Communications and Media 15 

4. Construction ^ 

5. Consumer and Homemaklng Education ^ 

6. Environment 3 

7. Fine Arts and Humanities 2 

8. Health * 15 

9. Hospitality and Recreation 5 

10. Manufacturing 3 

11. Marine Science 1 

12. Marketing and Distribution 7 

13. Personal Services 20 
Public Services 19 

15. Transportation "* ^ 



The data in Table 11 Indicates that Project REAL students were placed 
in Jobs that were distributed across the U.S. Office of Education's 
designated fifteen job clusters. 



!. ^ .S. Office of Kduration Fifteen Job Cluster^5 
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Learning :e Analysis Forms (LSAF's) have been prepared by Project 
REAL staff for each community work site. LSAF's include a description of 
the materlal3, tools, equipment and job tasks students may encounter at 
each site. LSAF's are used to develop specific site learning objectives 
that in turn are used in preparing student projects. 

Review of a representative sample of LSAF's (N=»15) indicate that 
these forms have been completed satisfactorily • Specific job tasks have 
been delineated; tools, materials and other resources available at the 
work site identified; and an overall description of the job are included 
in the LSAF's. In only a few instances were LSAF's completed without 
face-to-face contact with job representatives. 

In addition to LSAF's, Project REAL has also prepared an Employer's 
Agreement Form that describes the terms and conditions under which 
the employer agrees to participate in providing job experiences for 
students • 

B . Have Project REAL Students Been Awarded Credit Toward a High School 
Diploma for Successful Completion of Program Activities ? 

The Delaware State Board of education and the Newark School District 

have established guidelines regarding the award of credit toward ^ high 

school diploma for students pursuing alternative secondary education 

programs* The State Board of Education and the Newark School District 

require a minimum of 18 approved credits to be awarded a high school 

diploma . 
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State and district policy provides for: *^..the 
^- granting of the maximum of three credits toward graduation 

for a combination of approved and . .idlvldualized programs 
which Include: independent study projects arranged with 
appropriate school administrators and staff persons and 
approved and supervised work experiences in the school and 
comnmnity which meet the educational objectives or special 
career Interests of an individual student/*"^ 

Nonetheless, all project REAL credits can be applied to the 18 
minimum required for graduation, additional credits for Project REAL 
projects were awarded lieyond the 18 credit minimum to insure that each 
student received appropriate academic credit consistent with the time 
spent in Project REAL. One-half credit was awarded for each project 
completed with additional credit awarded for successful completion of 
career competencies and explorations. 

Project REAL staff developed and distributed to students and their 
parents guidelines for the award of credit for participation in the 
project. ETS staff reviewed these guidelines, supportive forms, 
and other documents and monitored their use. Although each of the 
three project sites have particularized guidelines for awarding credit, 
there was a high degree of consistency among the sites In applying the 
guidelines* 

Interviews with students at each of the project sites indirated 
that they felt the guidelines and procf^.dures for awarding cre^dit. were 
reasonable and equitable* Although project staff reported that the 
guidelines were appropriate, they did say that determining the academii 
area in which credit should be granted for particular projert^^ was 
difficult cind time consuming. During the Summer of 19 7 7 prnjiM-r. ^VAtt 



1 . N ew a r k , Del awa r e , A Proposal for th e Imp Um.ent,at Jon_.oX_>{.on:Ii^^^ 
MRi£IllL^illg^^JLl!2gL g^^^^ Laboratonies EBCH M odel , 19 7 6 . 
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reviewed the guidelines and made revision where necessary. These guide- 
lines were implemented during the second year of Project REAL. 

C . Has Project REAL Implemented Sex-Fair Guidance, Placement. Counseling 
and Follow-up Services ? 

Project REAL has prepared a comprehensive plan for dealing with sex bias 

and fjex discrimination issues that relate to the project. The plan 

Includes : 

9 Staff development activities to familiarize staff with sex 
bias and sex discrimination issues in career education. 

• Strategies and procedures for dealing with these issues 
on a student level. 

• Student process objectives in guidance and counseling, 
t Guidelines for the selection of non-textbook materials. 

• Guidelines for dealing with controversial instructional 
materials . 

• Checklist for evaluating materials for racial and sex 
dlscriminationi 

The comprehensive plan for treating sex bias and sex discrimination 
Issues was developed late in the Spring of 1977 and was Injplemented in 
:he project's second year of operation- 
Project REAL has also developed and implemented a student pla^eninnr 
-infi follow-up sy5-3tem to account for the Job placenicnt '"^f onch studont wtn- 
.graduates or leaves the project. Table 12 summarizes '^.tudent plactMnHrr 
\r \ r" Ml-^w-un data across the three project sites, 



I" 
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Table 12 

Project REAI. Follov-up Information 

Grade 11 Grade 12 



Total Number Enrolled In Project REAL 30 3A 

Graduated — Enrolled in College — 22 

Graduated — Placed in Job 12 
Graduated — Not placed in Job or College 

Completed program and promoted 22 — 

Dropped out of Project REAL and 14 4 

returned to regular classsroora 

Dropped out of school 

Transferred out of Dlsstrict 15 
Re-'enrolled In Project REAL for second-year 3 



^ • Has Pt olect REAI. Implemented a Student Assessment Program ? 

Project REAL has Implemented a student assessment program in the basic 

skill areas and career development. The California Test of Basic Skills 

(CTBS) and the Colleg^^ Board's Career Skills Assessment Program (CSAP) 

test hattprv were ;idml nlst ered to all Incoming project students. The test 

rt^sulrs were used hv project staff In developing Individualized learning 

plains li.e^ projects, explorations, etc*') for student^3. the subtests 

'"^v^^^ r ed hv the ('Ty^/S inrlude: 

1 * Rend i 
.': • !-angnas<e 
■ * Matherr.it i rs 

Ref eren<'e i ! \ 
. Sri encp 
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Interpretation of test scores for instructional use is based on 
comparison with the CTBS national norming sample. In those instances 
when students score below the 50th percentile in a particular basic skill 
area, individual learning plans are prepared to offer students special 
instruction in this area. 

In addition to the use of the CTBS on a pre-entry assessment basis, 
the results of the CTBR pretes t-pos ttes t analysis were also used by 
Project REAL staff to Identify specific parts of the test that students 
tended to do poorly. An item analysis of the CTBS has been done by 
Project staff to identify content areas of the test where student achieve- 
ment was less than anticipated. The results of the item analysis were 
then used to develop individual learning modules (e*g. computational 
skills, reading). Plans call for Incorporating these modules into 
student projects during the Project's second year of operation when the 
results of students pre-assessment Indicate low achievement in a speci- 
fic basic skill area. 

The CSAP test battery include the following measures: 

1. Career Decision Making Skills 

2. Employment Seeking Skills 

The CSAP battery was administered on a pretest-post test basis to Project 
REAL students and the comparison group, Annlysip of rovarlance st-itis-- 
tlcal procedures were used to estimate stvident ach. ievement on t^arh of the 
rSAP measures . 

The results of the CTBS and ('SAP pretest-p^^st tef.t ;?dni nis t r.it 1 ■ -n 
fin? f otind i n a prev i ouf? sect ion of t h 1 repor t • 



Findings 

The findings of Project REAl/s student prcc(BSS evahiation ^tre? 

1. Project REAL students completed the required numb^tr of 
exploratory experiences and projects* 

2. Policies, procedureSf and guidellnoi^ for grading and 
the award of credit tov?ard a high school diploma are 
well-structured and functional* 

3. Project REAL students have been placed In a broad array of 
communl tv work experl ences • 

4* A compreht^n.sis'e plan for dealing with sex bias and s<2K 

discrimination issues that relate Ko Project REAL students 
has been p rav>ared and imp 1 emented <> 

5, A plac*^ment and follow-up system ha^ been dc-voloperi 
and ImplcfM^nted. 

6. A comprehensive student assessment systeti) has bo^vo 
impletnentr-d in the basic ski 3 1 areas and carpei 
education. 

Cone lus ions 

Conclusions drawn from Project REAL's prorc'.NS evMii.irttion section are: 

U Project RF.aL has achieved itr s^ndt-nt process goals .-^nd 
obj ect I v(->K as outilnt^d in its pr^nns^^i and as specified 
In Its management plan* These Inr 1 .ide placing students 
in a br o/id .^irray of cowAini ty work si te<? , imp lenient 1 ng. 
a cotnp rehen:ii ve s'^udent assessment syst (:>n, providing 
students with Instructions in the are:^ of c.ex bia«^^ and 
Si ex di sc rlnii na t i on and award i n<> student s o ri^d i r. f 
parr i r i pat i on in the project. 
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Recommendations 

The following are the recommendations for this section of the evaluation 
report ; 

1. Project REAL should cent inn* to expand the number 
and variety of community work sites for the 
project's third year of operation* 

2. Project REAL should continue to refine the quality 
and breadth of LSAFs consistent with additional 
community work sites • 
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SECTION IV. PROJECT REAL MANAGEMENT PROCESS QUESTIONS 
A . Has a n Overall Project Management Plan Been Developed and Implemanted 
The director of Project REAL has prepared and implemented a management 
plan that Includes the following elements: 

• Goal Statements : A description of the broad goals of 
Project REAL. 

• Objectives ; A description of the objectives related to 
each of the broad goal statements* 

• Activities : A description of the activities designed to 
accomplish the stated goals and objectives. 

• Completion Dates ! The anticipated start and completion 
dates for accomplishing each of the stated goals and 
obj ect Ives . 

• Resource Allocation ; A description of the human and 
financial resources allocated to each of the goal and 
obj ective areas • 

• Person(sJ Responsible : The narae(s) of the person(s) 
responsible for undertaking project activities* 

Analysis and review of the management plan indicates that project 
goals and objectives have been linked to proposed project activities, 
start and completion dates have been established for each of these 
activities, and financial and human resources have been referenred to 
;*ach of the project activities. 
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B. Has Parental Approval for Participation In Project REAL and th e 
Third-Party Evaluation Been Collected for Each S tude nt in the Project 

Pf^rents of students expressing an interest in participating in Project 

REAL were informed concerning the requirement for prior parental approval 

for students by mail and during an orientation session. A checklist 

procedure was developed and implemented by the project^s staff to insure 

that parental approval was secured prior to student participation. 

Student folders were prepared that contained the following forms: 

parental permission, insurance, accident, and transportation. An ETS 

representative examined each student's folder early in the Fall of 

1977 and found that a signed parental permission form and other necessary 

forms were present for all Project REAL students. Further examination 

of the dates of the parental form revealed that permission had been 

granted by parents prior to student involvement in the project « 

C. Have Provisions Been Implemented to Guarantee the Safety and General 
W ell Being of Project REAL Students ? 

Insurance protection for Project REAL students was provided through 

student participation in the Newark School District's insurance plan or 

through individual family coverage. Students utilizing private vehicles 

for transportation to and from school and community work sites were 

also required to demonstrate adequate Insurance protection of himself/ 

herselfs the vehicle and passengers* Students transported on District 

owned and opfi^rated vehicles were covered rhrouj?,h the Dl.strict's Insurrince 

plan. Also, liability insi^r^nce protection for c?mployers Involve^d In 

Project. REAL was provided by tht? District. F.xaml nation of student 

folders Indicated that all of the studentsi were onrt^lled in either the 

nistrtcr"? or their familv's insurance pro30;ram. 
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Project REAL on-site community work activities were of the non-paid 
variety and were designed to be in compliance with the child labor 
provision of the Fair Standards Act. Also, a copy of Project REAL's 
proposal was submitted to the Area Director of the Department of Labor to 
Inform him of the Director of Newark's intentions in implementing Project 
REAL. 

D . What Was the Nature and Extent of Project REAL Staff Development 
Activities ? 

A variety of staff development activities were organized by Project 
real's director. The-se include such activities as: 

1. Developing a program description booklet for Newark 
High School's project. 

2. Preparing a dissemination plan for informing 
community groups about the project. 

3. Refining of basic competencies procedures. 

4. Redesigning sound/slide presentation and related 
orientation materials* 

5* Revising all project forms, and so on. 
6. Evaluating existing community work sites and 
identifying new sites* 

In addition to these activities, Project REAL staff conducted an 

internal evaluation of the project. Each of Project REAl/s staff worked 

approximately 90 hours during the summer months on staff devt? lopme.nt 

act ivlt les. 
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E . Has the Necessary Prolect Staff Been Employed in Keeping vlth the 
Prolect's Proposal ? 

T .e following personnel have been eniployed and are present at each of 

the three Project sites: one learning manager, one community coordinator 

and one clerical assistant. A full-time project director has also 

been employed and is located in Newark School District's central office* 

Each of the staff has been provided with a job description listing the 

appropriate tasks, roles and responsibilities* A personnel review 

procedure has been Implemented to ensure periodic evaluation of all 

Project REAL personnel* 

F. Has a Project REAL Advisory Board Been Established ? 

For the past four year the Newark School District has maintained an 
external career education advisory council that was established as 
part of the district's involvement in the Career Educational Instruc- 
tional Systems Project. The council meets monthly and its membership 
Includes representatives of business, industry, state and local govern- 
ments, state education agencies, and a variety of professions as well. 
The purpose of the council is to advise the superintendent on broad areas 
of concern in the field of career education and to establish a basis for 
community support. Because the council continues to meet on a regular 
basis, a decision was made in early September, 1976 to form a subcommittee 
or task force of the council as an advisory board to Project REAL. 
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G . To What Extent was Project REAL Iipp l amented as Planned ? 
Learning Centers : Learning centers have been established as planned 
In each of the three Project REAL sites. These centers are located 
in classrooms r^nd have sufficient desks, file cabinets, audio-visual, 
duplicating equipment and other materials and supplies to allow the 
center to function as a self-contained unit. A single classroom in 
Christiana and Glasgow High Schools has been designated as a Project REAL 
learning center* Due to Increased enrollment in Project REAL in Newark 
High School during the second year three classrooms have been added for 
Project real's use. 

Transportation : Transportation of Project REAL students to and from 
worksites appears to have not been a significant problem. Unlike other 
experience-based career education projects. Project REAL requires that 
students make arrangements for their own transportation. However, 
although staff and students did not report this as a problem, it may 
be a self-limiting mechanism that prevents expansion of Project REAL 
in those instances where public or private transportation may not be 
available to some students wishing to enroll in the project. 

C ommunity Work Sites : The staff of Project REAL have identified in 
excess of 135 community work sites. The work experiences found in 
these sites represent a broad array of jobs and job clusters spanning 
the 15 job clusters classified by USOE.^ ETS Interviewed a represen- 
tative sample ol 10 employers who participated in the project during the 
Spring of 1978* The employers interviewed uniformly had positive reac- 
tions to Project REAL, expressed an interest in conrinuing their 



1* Refer to page 20 for a list of student v;ork experiences in 
each of the 15 job ciustersv 




Involvement in the project and thought that Project REAl. provided students 

with first hand experience of demands In an employment settings. The 

analysis of Community Instructor's Rating forms are included In a previous 
section of this report. 

Project REAL Site Character i stics 

ETS administered the Implementation Site E ssen tial Characteristics 
Ch ecklist prepared by NWREL^s experience-based career education staff 
to assess Project REAL's site characteristics. The findings of the 
Chec klist indicate that Project REAL; 

• provided individualized Instruction to students 

• utilized community resources as a basis for instruction 

• built on career related activities of adult itiembers 
of the work force 

• represented a comprehensive and integraued educational 
program 

f focused primarily on the career developmjint of students 

Comparison between these broad findings and Project REAL's first 
year proposal and its management plan indicate that Project REAL exhibits 
the essential characteristics of an experience-based career education 
project. The completed Implementation Site Esse nt lal_ CtiarAc.tA^l^^ 
Checkl 1 3t is contained in Appendix B. 



1. Refer to page 20 for a list of student work experiences in t?Arh of t'ne 
15 job clusters. 



Flndlngs; 

The findings of the Project REAL management process evaluation are: 

1* Project REAL has developed and implemented a project 

management plan. 
2» Parental permission for student participation in 

Project REAL and evaluation activities was secured 

prior to start of project. 
3. Insurance provisions have been provided to assure 

the safety of project participants. 
A< A comprehensive staff development plan has been 

prepared and implemented. 

5. Project staff have been employed consistent with 
management plan and project proposal. 

6. A Project Advisory Board has been established and 
meets on a regular basis. 

Conclusions ; 

The overall conclusion of the Project REAL management process evaluation 
is: 

1. Project REAL has been implemented consistent with the 
project's proposal and management plan. A review of 
the Implementation Site Essential Characteristics Checklist 
reveals that Project REAL has in operation those activities 
that are essential to an experience-based career education 
project . 
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APPENDIX A 



Kvalaatiion Plan — -^roject: RliAL 
October 1, 1976 - September 30, 1977 

The evaluation plan for Project RE^VL's first year of implementation is 
contained in this document:. The plan includes evaluation questions that will 
be adircstied to determine the extent to which: 

f Project RliAL has been ir.piorr.onted in accordance vltii ito 
proposal . 

• Student process objectives and product ouCccr.es hjve bet.v.i 
attai:ied . 

• Assurances .^specified by the United States Office :?f 
Education have been achieved. 

The evaluation plan is presented in th.rea parts. Part A of the pljn lisr.s 

questions related to student outcomes; Part B contain^ quesrio;:s about: student 

process objectives; and Part C specifies questions linked to project riana::er;.en t 

tasks. Specifically the foi-^.at of the plan is as follows: 

' ^'^''^iMat ion Questions : A description of the t.^pic or 
area ev.iiuated in three broad areas: 

Part A - Student Outco:ne Evaluation Questions 
Part li - [student Process Evaluation Questions 
Part C - Mana^^emcnt Prt^^ess Evaluation Question.; 

* D'^ta Source : Lists data sources that will be usLid to 
provide inf orr.iation about each evaluation qui.\stion, A 
list of the data sources and code nu:v.bors is pr'v;ent;.»d 
Appc?ndi:-: A, Doounicnt:: Checlilist. 

* Tine Data ! .^ote d: D.it.i collection t ir:e \'l■^r.A' by K.ill, 
WinLer or .v.n'LP,':* 
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APPENDIX A (CONTp) 



* ' - ^} ^ j. > J^gs i ' Specific trv'pe of dosi'^n to bo iisoci: 

-r o rnu.it ive 
-Sur.n.itive 

-Pretes t/Posttost ; Posttost only 

* Describes the type of analysis to be usiad, sucii 
.^^i nom group co:,\parison, analysis of variance or 
covariancG and so on. 

^ ^^rg et Criteria ; A description of the criteria or 
standards to be used to assess whether or not tb.e 
evaluation question has been ansv;ered in the desired 
direction. 

* S ir'/r le : The ;^anple (or population) of subjects or 
^iocur.ont^^ to be analysed » 

3acaui5r.2 Pro j oc t PsEAL is in its format ive. stage of develop:"cni: and irr.pl^- 
rp.enLatlon, tl;e evaluation plan must also be used and interpreted v;ith a rr.uiasr.rd' 
or f lw-i::ibility • L'nknovn factors and events will most assuredly ter.ipor so::iv3 of 
the plants specifications. The preparation of the plan has included di/3cus -Jiorio 
with the director of Project REAL to assure that its specifications are 
consistent with t:;e overall project as interpreted by Educat ion:il Tcs:;in.': r-ov":.^' 
(ETS), and furi'uer that the criteria cs t:ibl islie J to wei':h accop.r l:.r3i;;.;er.t.? .ir%^ 
ro-'ilijtic in Ii;;i;t of th.e allooatjji of resn-ircjs. Project RLVL.'s eva lua t 
plan was appro\*eii by tl^.^ project's diir-^-ctor on Fubruary 17, ly^'T. 

Tiie sub^;ocii:(?nL part of this iioc-mont pr^>Stints ProjocL ; o\'ii::.;r: :\ 

plan for its first year of oporation. 
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sfuJi-ntb ; 

lUU'lSU curnparlbon 
Hnnip KCudt-niii 



t 




Projtict RtAl, SCudiinl OiiUpnu Bv^limtlun gui!iitlon» 



scuJtiitC OutcoMe Evaluation 
Qu««Cion« 



Data 
Sourctt 



Tina 
DaC« Collccced 



Evaluation 



Analysis 



Target 
Crltflrla 



Sanple 



ihyy b^uJtfrits (JcBonytraC«id . ... . . . lU-18 

^ucci*ssful coaplacion of at ConpttancLts ' 

iuMiit sttvon of tha foUowlhg - Record 
I) comp«!t«nclisr 



'I. 



•4. 

M. 

M. , 



'Trjni»JCt busioosg ort a 
creJit bayist 
M.Unt4tn 4 chucking 
jccoutit tn KooU crUer* 
Froviiia aJoqu^Ua Ini.urjncu 
ror aulf, family and 

Ktlti yCattt and federal 
income tJXOtt. 
Omli{vt tlmtt and oioncy 
i't (tictivuly. 

.V.iLtUJin Lliit bc'iit pliy-ili jl 
Itcjlthi and Bjke .ipprupri- 
.itif use of Ittluure timi>. 
Kc^po(\d jpprupr ijcul y lo 
tire I police .ii\d phvisic.il 
liwMltU vmitrgencicb. 
i'.irc In; ip.ilc In thu uU'l- 
cor.il pruccbii. 
CiuU*{ »C jtitj lliL* 1ms I c 
^>trucCur«! jnJ t'tmllun 
ut locjl govcrnnctUi 
Ixpljiii your owh Iu^jI 
ri^hi^ aitJ rebpjti:iibl 1 i c. leu . 
M ikt* .ipproprt.Ko u!it* of 

tikk' jppLlcaliuii fur cciploy- 
MMU jnj buctje jaf ulLy lioIJ 
1 )ob. 

lilt imoh 1 1 



.Spring 



SuMfBatlyu 
Post-teat 



-Nunbur and perctnt^ 
aga of aiudtnta 
Mating target 
criteria 



aOOZ of projacc REAL 
litudanta ■ueccasfully 
coRpletlng 7 
conp«t«ncittt 



Total population 
of projacc REA1< ' 
•cudontM 



I 

U) 
00 

I 



4 ; 



ERIC 



4 



FtKurc I. Evaluaiioii FUn^'-PMrt b 

l^rojuut KKAL SCiidunt Pr()vfi8ii KvtiilUat luii QiiuHt Ioiin 



Quustlons 



Pat A 
Source 



Tine 
Data CoUecud 



Evaliidiion 
liGiiign 



T«r|ec 
Criteria 



Sanple 



J I hUvv utndents been pi a cu J 
in (he work place In ^x- 

ploTJCory anil learning 
I- vcl act rvlclca? 

.ii Won jnatiy muJunkv wUhln 
^MCll Qt tlic* proJci!t 
schools havu been placed 
111 cxplorJtory and 
learning levul autlvUluii? 
In what Job uaiugorlua 
or cluiiLertt wcru the 
student It placed? 
Hov m.my studenca were 
(Miced In eiich of Owav 
.jte^orlet or clusiterH? 

I* Old ihti vxplurjtory uiul 
lu.irnln); level actlvltlftt 
.illov the ecudentii to 
liiierjct with ndiiU 
r.L'mbers of work force? 
«'i Wjs instt ruction pro- 
viJed thii HtiidentM re- 
i'.ariln^; possible :»ex bi iNi s 
nr ftttftuoiypluK In iUl* 

'.tire thw ni'iL-i^.ity ptL'n— 
ijiiltlcu jud t.>lli)W(ip 
prov:ediirfS .md fvrmi 
.1 iboc I jt<.'d wllh Job pl it r- 
r. i.t coraplettiJ by d\\ t!;e 
pji*clet» lavuJvi'd' 



Spring 



Siimniitlvti Fr(i(|uoncli*H| 



PoHC*ceat 



I)-29 Kxpluraclon 
(!uldii 

U-9 Project Kor» 
(liiarning luvclii) 



I>-31 ProtryH 
Kv.t lu.it Ion Kunn 



percentaKes; 

i:oMp.arlKun . 
between three 
project RKAI. 
hltib uehtMilH 



fiUurvii W'i 



mx of project KF^L 
Ntudenta placed in 
1 expljoratory oxporienceii 
and 2 or more laarhlhg 
level activitlee 



niHtrlbution acroaa 15 OC 
|ub c luster 



lUOt of project KLAI. 
tiliideiitH interacted wltli 
adul Iti 



lun: of project RKAL 
studeiiiH provided Inetruction 



Siiiilent foldetM contuiii 
•ill Ihu pri'rei|uitf itf (orn.s 
(Siju lkn:umi'iU tf list) 



Total population of 
project REAL 
Htudon'ta< ^ . 



Ditto Above. 



Ditto Above. 



Ditto Abuvt! 



DItcu Abovu. 



I 

to 

SO 

I 



4 



Projuct Ki^ Student HrocvMii KviluMtlon Qtit*Ktiui:s 



^ClideIlt Procova Cvaluition 
Quo it Ion* 



Uota 
Source 



Tlom 
Data CoVlttCtfid 



Kvaliiation 
Daulgn 



Analysia 



Targat 
Critaria 



Sanpla 



Ui!> crvJtt toward J acliool D^23 . 

t] i ;> I * *ru }ii r .1 n t dd for ucc it it a 1 1 1 P rue u» 

. ■ '.(ilb't of progpiM .ict&vltlttu? Kv.iliiutluii Kunn 

l>-9 

I, (Mve gviidnlittas anJ policy Projuct Pona 

tiCJtomtfnta bean duvolopud for 1>*19 Student 

4v/jrd(ng cradle coward a liigti Platming Form 

:icliool diploaa? IHlo Ktudunt 

b. Ar«* thu guidelines and policy Report Cnrds 
iCjivncnta batng cuiu t utviit Ly 
jppltMd jnong tha tlirea 

I -.1(1 ItMic i| p.irt (US .mil 

If «)1 lliv sLUcmiMit s ? 
• foiTn-i bui'Ci dt.'VL' U>pi'J fur 



Spring 



Pom t -teat 



8avlcw of 
ieredltiug 
policy und 
procadurea, 
Cowparatlvti 
anatyala butwutin 
planned and 
actual 

Implemontat ion of 
proctfdureu. 



loot of jtiudonta 
ja'anploJ ahall liavc 
aiiccoanfMlly baan 
awarded crcrdlt 
toward a high achool 
diplona based upon 
project REAL 
exparlencea 



Random aanplo of/ w 
SOtof atudcnta^ 
vt iiach achool a Ho 



.^1 



irtudv*nt Proccis Evaluation 
Quttitioni 



Evaluation Plan — Part B , 
Projtict RKAL Studant Procuaa Kvaluatton QuttKtiun 



m 



Data 
Sourca 



, Tim% . .. 
Data Colloctad 



Eyaluatlojn 
Design 



Analyaia 



Target 
Critaria 



Sa«pla 



lUvtt icx-'fair guidance » uotin»el- D-26 

pUciiavnt and followup aer- Procaaa 

vicus btftfn laplamentcd? Evaluation 

Foni 

1. H.1VII proccaa and MraiurabLe D-26 

ttCuJent outcone object ivaa H.inaKeMnc 

fpr aex'fAir guidance and Plan 

coiiniellng been developed? Project Recordi 

b, tljtf a itudent follow-up plan 
been developed and Inplemeaced 
to account for the placemisnc 
or' each student who graduatiie 
ttun high ^uhooL or drupii 
•uic of the project? 



Spring 



Forautive 



CoMparat ive 
analyula 

between 

planned 

and actual 

iaplcMntation 

of uex-fair 

guidance, 

counaulingt 

plaCiiMent and 

follow-up 

scrvicee. 



lOOZ of procesa 
and outcoM objectives. 



lOOX of procaaa and 
outcoM objectives related 
to aax-fair guidance and 
counaaling will be Random aaapU of 

Isplemented according to the 50Z of studenta at 
plan. each school site 

lOOZ of student follow-up 
saMple will be accounted for. 



I 



>eu»ltfnt Proc<«i Evdlu.itlon 


l^'^ta 


TlM 


Evaluation 




Quigtiona 


Sourca 


IXita Collactcd 


beaign ' :~ 


Analygia 


fUii a eofliprthtnsivt student 


D-17 


Spring and 


Formative 


Deacriptivs analyaia 


■i'AiiviiiMnt prograa been • 


Cartfriciitioh 


Fall 




of iitudant. 


liJcMUlf itd» tapUaenttJ 


Fom 






aaaeMHMnt prograsi 


.i.;J uClliSCd) 


U-iB 






Coaparative 




Coaptiriineiaa 






analyaia biitveen 


j> li.we Individual Isud 


Record 






planned and actual 


K'jrnlng. plant buun 








Inpleaentatlon. 


prop^rtJ for 


ScudoiU 






Content analyiilH of 


pro]«cc REAL atudunta? 


Phinning Pura 






learning plana. 


b. UU the Indivlduallxad 


E>-29 








ltf.irnlng plana provldn 


Project ftEAL 








tor instruction in llfu 


proposal 








ilia, b.k:ilC HkllU 


Oii-alto vltfita 








1(1 1 i~.ir<?ur Uovclop- 


l>-l 








it / 


KUUE 










1 :iii(!htlaL 










CliurdccerlvdcH 










ChcckllHt 










l)-2 




















Prucustt 










(JtUL'kl 1 ut 










Stuiluni KoMli's 









Target 
Grltoria 



Saaple 



AaaeatMnt Inforvation 
ptovidtd to itaff. 
shall Include! (I) 
career developtoent» and 
(2) basic ecadeeiic akilla 
dat«. 

1002 of pUna 
ruviuved shall have 
provialuiis fur 
Individualised inatruction. 

100% of planH reviewed 
Khali Incliidu instruction 
III cacli of tliu following 
aru.-iH; life HklllN, basic 
tiklllM .iiu) i^arvur 
duvulopnmit . 



Randoa aaBpla of 50Z 

of a£udan.ti. jarejic.^^^^^ 
achool atta 



M 


1 


X 






> 


1 


§ 




a 






4r -^^iiiis*^ 



Kiguru I. Evaluation Plan— Part C 



Project KEAl. Managvpcnt Proceai Kvaluutlun (MCtttlmm 



•unv'icnt Procaai KvaluJtlon 
i}uicatlpM 



Data 

Suiirca ' 



TlM 

ColUetiid 



Evaluation 
lj«iai8n 



AnalytfU 



la jrt uv«raU projtet aanatienient D-26 
111 been davalopad and Inpia- Project Rl-J^l. 

M.inng««unt Plan 
U-21 

Muvct project gOAltf iinJ objcc- ProcuKM Kvaluutluit 

Clveii buen linkeit to planiiuJ Konn 

pr^ijtict jctlvttlux? 

Hivu atjrt JnJ completion 

J.tiuti buen OBtabllsUuU r'or 

uicli of Che planned project 

.K'C tvltlea? 

liivi; llnjnclal dnJ human 
r> -iwiurcusi buun rvt'uruncoJ 
( > \',u \\ oi tiiu pLinnuii (>i'ojk'ci 
.1 iivtetuti? 



Vail 

Winter 

Spring 



Forma clvtt 



Vurlfleatiun of 
duvulopmeiit and 
ImplunentHtlon of 
■aiiegenunt plan* 



Target 
Criteria 



Sa«ple 



Hiinage«enc plan 
•tiall be developed ' 
and iMpleaented In 
accordance with 
apeclf leatlon I.e. 
Conpariitlvi! aiialyaitt evaluation queatlons» 
bvtwtiun plannud end 

actual nanagvKunt \mx of »aiiage»ent 
actlviii«*». actlvltlea analyxed 

wUl be laplcMentud 
according to plana 
uiilosta adequate 
dociimuntat Ion for 
(li.in(*i*ti iw pruuent. 



^r— — — 

Randoii 

aanple of 2SX of 
nanugvncnt activities 
Invaatlgated In dapth* 



=~ _ _.. „ 




ERIC 



'i:ii^cfflt;nc Protftfiiif tivuluation 



10. (^i • parv^ncal approval lot 
i .1 Lictpatton In project 
r. \1 an J levaiuuClun be<in 
. *lU'OCtiJ for itach tftuili;nC , 
t . (ito project? 

Hivtf parent k bevn in(orinuil 
..iiucrnlng tiitf r^quirttnuiit 
t »r prior approval? 
t. . i.iiiL procniluros were 

.tt'vcloptiJ to hvsiiire ihai 
, irctual .ipprovjl wa» 

> iirc>i prior to partlcl- 
, a I Oil ? 

■ . 1- . ij.uti Stmit-MU p.Utli'i- 
it m • tUc pruJi'Ct li.ivf 

I 4 i> ( ) 1 v;nc'(i by t>.iictit (^j ) ) 
I i«i » or luT iiiJ L viiid i 1 
; ,M. t ? 



Kvaiuailon IM*in—l*art j: 
Projuiit RKAI. H^imguatint Vrocega i^valuat ttiii »?Mw».tionii 



Data 
Suurcu 



TlMe 

(iMta OoUuctud 



Kvaiuul ion 
Design 



Target 

CrltcrU 



Saaple 



Winter 1977 
Vull for 
duccemiivu 
yeara 



{Juuiwatlvu 
Post-tvai 



Frui{uunclea, 
puri'viUagos 
qC pfiiKenue 
of puroittul 
purnlaslon 



IQOX of project MIAL 
itudenta have sl&ned 
parental parBiaston 
foma In folders 



100?; of project 
RtAL itudentii 



IniiurancQ, Transiportat ion 
.mU Auuldoni Korm 
P.irenta* 
Lotrer 



i uMiTt 



X 



o 



I 
I 



1-.; .ii 




KvtTluatluM PU»--H.'irt V. 
Hrojocl. RKAL HmiagCBiKnt Prpooiiu Kvaluatluii (juuvtlonu 



11. 



t'M^irivMt PruoouM tv.ktii.it ion 


Dut^t 


Tine 


kvvaluat ion 




Target 




Source 


Data CalluctaJ 


DeelKn 


Aiulyuii 


Criteria 


.Mv« » rovidlon» been Inplunontitd 




Spring 


SuAMClve 


Conparlnon 


lOOX coapllancc 




Indemnity 






between 


wlch apeclfied 


..ti.'rul wtill-biilng of tlii> fttudiMitu? 


Iiiuuraiice 






planned 


assurancci i.e. 




Policy 






and actual 


queetlone 1-4 




l>-4 Innurancu, 






avtivit iuu 




rr-'VldtM for by ihc Nuw^tk 


Traneportat Ion 






related to 




. 1. Dlbcr ice jnd/or cliu 


jnd Ai'Cldunt 






Btiident 




w«il>'nL tu eovor littn or iicr 








Hufuty and 




1.^1 li' being transporCi'd to 








well -being, 




■ r roB work slCc fis 












u.- 1 1 .!>> un-tilCtt work 








Review of 






D-6 






project 




L , ci'i- irdliig OD'SlCe wurk 


(-Implviyur'M 






corri^Hpondunci! 




nlited project activities, 


AKruumLMit Kurm 






to document 




1'. thosu dctivitluM condiict- 


U-H LuartilMK 






ri'iidinniLMiftiMl 




1 1 Ml II in tb'j provlsloh;i ut tin* 


Site AiulyulM 






procp.durt'ti . 




1 ilr l.ibor Stand.ird.4 Ai.t- 


t'onn 








; < } ir I Ic Ipal tn^ cmp loyi i*^ 












> t the provibloiw of tlio 


Fttiployi'C 










> M'at liXi il Sdttil y .irul 


liilrrvluw Si'ltodiilo 










»i 1 Uh Av I ? 












I. f .'.L.* ^ r i.)t.i,'d>i ru!i bi'iii ini^li 


l'ru|i'cC K^>l. 










!i(<-.j ( tKh^ the .it>iJt i iiir 


M.iiKij'.iniciit pl.ti) 










' 1 > i 1*1 rector to In >u{ i> 













Sample 



Not Applicable 



\ u. i' I .It Ion tiitd jdvi>iL' 
1 .1 ..'o II Jiir lu V 1 . 



I 

IN 
I 



ERIC 



Quefttoni 



Data 
Spurce 



Evluatlon PIan->-Part C 
ProJtcC REAL HaitaitswinC ProceuH Evaluatlun (jueatign 



Timt 
D«t« CoUictsd 



Evaluntlou 
Dottign 



Analyvii 



TargttC 
Crltttrlt 



v«lKit was Cht nacurt of Project 
KKAL atA^r dirvislopaiiitc actlvl- 



•1 • 



D-25 

Plan 
D-23 
Procttaiu 
Evaluation 
Korn 

Staff Devdlopnunt 



Spring and 
Fail 



formative 



How many central otfice and 
project REAL staff partUl- 
pjttd in utaft dtivulopntiiu 
activltUu? 

Has a coftpmhcnblvfi plau luan Plan 
dtivclopiiJ fur tftafr duvalop- Hunting agenda 
iRcnt during tlie curmnt Interviewu with 

fiscal year? prolouc RE^L 

tlow maity, and ai what tluiis, vtaff 
ii.ivc staff dcvulopuiuiic ntsetlufitt 
bi'vn livid? 

l.li.it toplc:i| aitd whu wuic tlie 
presenturK, at vach of tta>iii! 
ricif I in^k? 

Uliat were ctto p.iri Iclp.incs i 
opinions .iboiit tho v.tluL* iiiul 
of CtiCC Irenes of tiifiio 
mi'i't Ingi? 

(Li's J prot"eJiiri' bc^a <li'vol«)pi.'J ^ 
(or iiullccttut; littot mat ton 
t turn .tCjtl .itioiic lliv MLM..! 
lor aJdltlv>u il ai.il t JL*Vk'Uj|>- 
{iii-nt Ji t Iv 1 C ii'r. 



Gonparativti 
dn<llysU bctwQan 
prpjecc plana 
aitd actual 
staff devtilopRcnt 
actlvltltis. 

Review of staff 
devolopHi'itt 
agenda (a) 

Content analysis 
of staff 

development plan. 



A 



lOOZ of project REAL 
at^ff should be involved 
in 4 or More ateff develop- 
Mnt actlvltlea. 

A coaprehenslve atsff 
devalopAent plan should 
be available and evidence 
to suk'gest its iiiple»en« 
tation. 

Stuff dcvelopcent follow-up 
proci^dures should be 
developed and isiplementud. 

Staff Input into developmunt 
uccivleiud should be present. 



lOOZ of project 
R^AL ^taff 




: iii.iCi mom Pfui.>unH I voliiiil iun 
<hietcions 



13, ' 111- iho nticesKary pryjcct biuff been 
. .it.'Vi'J in kui^plnK with the project'ti 

I, Mil J t'ull-tlmc pr»Juct Ul rector/ 

: t Mj^cr been miplo^tfd to supervUu 

C'f gvtfrall npoiation and dirucliou 
111 the project ? 

K tvi.' the prercsiil !ii tc nu4nber of 

l-'irner man^K*?''^ heeii I'lnplnyed? 

1- .vt' th<j f.rervtiuis itu iiumb«'i oi 

.. Ml iblK boon unpi^jyctr? 

' ■ I" .lU cmplovio:, [i%ivi\ p|ovid»:d 

I th t th.s< r Ipi i>Mt iii llu' i r 
I 'l.-. .inJ ri-^ponslh i U t ioK? 

n- I j'lp lovi'* '. il ist r Ihiil »'d .iiiuinj* 

to ciu* propositi 1 ' 

. J ptT^unnt 1 n v/ltw proLe^hirc 

/ri.]llr.il i:v.i t'Ml Itin ot all 
1 1. . t KL\I. pwr •» jfuu l ' 



Kv>clii»U ion ri.in" INirl (: 
Project Ki:M. M,in»i«i!m»tnl l»ro»iHtf Kv.iluallon iJuCHLlonu 



UW9 

Uaid ColUcUd 



Kvaiu^it Ion 
Dutiign 



Spring 



Project RbAl. 
HjnaguBent 
p I .in 
f>*26 

Sc.iff Jub 

dc'Si^ripLiOUM 

Priic'usb 
r.v.tluat Icni 
Kiirm 



Annlytittf 



TargtC 

CrieerU 



Sanplu 



CoHparliton 
between 
■unageMnt 
«puclflcaiiunti 
iiiid actual 
dUtrlbuiion 
find aUocatlon 
of staff. 



lUOX AgretMtnt 
bfstwceii pUnnsd and 
actual dlatrlbuClon 
Atkd allocation of 
tttaff. 



1002 Of project 
REAl acaff, 



ProJ«ct KBAL HahAttCMiit Prucus* EvaluaClon (^iiuNtibntf 



in.i 'L'RkMit ProctiiM Evaluation 



Sourct 



Ti«a / 
DflC« CoUocttd 



Evaluation 



Targtt 
Grlttria 



Saaplt 



vvrii <ulJ«iilntii «iit4bUslt(ij 
Jul use J for screening project. 
niti?rial» for »ex bl«» and 
.w\ iieercotyping? 

J> How wore the lulUellnoe 

.l**v<; loped? 

\ .1 it mattfrltiU wore 

3..-ricnuJ? 

T.I I vtut extent wuri: tlia 
i-jior iali nodif led| an J 

J. v' 

..lit procedures were 
J vi. lopo.i CO InHtiri' thjt 
ill prult.'Ct PLitortiiU aro 
iit>i* kt to tlie licreunluK 



Hld-Spring 



Pormttive 
PoKt-^teHt 



D"2i Proceee 
Kviihiatlon Kom 
Project guliicilnce, 
policy FCuturoeniMi 
procudurutti etc 



I'ltrrlrultyn unii 

In^it ruct fon materials 



Koviow by 
panel of Judgoe 
to aeee»e the 
pruuenco of 
fiex bias end 
vex stereotyping 
in maturluls* 



Sex biai and 
■ex atereotyplng 
■hall be absent 
fro« lOOZ of 
project ■aterials 
reviewed 



Rtndoa iaaple of 
of project 

REAL currlculua 
and instructional 
naterlirU. 



Evaluatton PUii'-Part C 
Project KSAt HHUngcuKni rtocottd Kvaluatioii Questions 



^vi:t tilv'nont rroc«git Evaluation 



Udta 
Source 



TlM 

DatA Collected 



Evaluation 
D«vlgn 



Tursot 
CV'lt«ri« 



Saciplc 



li. Il.is thu project R£AL advlnory board 
) ( I'n fstabllvhttd? 

I. './Ji ) nre tliv noabttr^? 
.tN '..re (;ulilcllni2< and policy 

stjter.onty developed for thu 

.•i'or-it ion of thu board? 

Did tliu .iJvUory board noet 

twi J ri!K^'l«ir ba^tls? 
■t. Uh.ic topicit aiiJ problvmii wore 

k-nored by chu advisory boird.' 

"t-* .III .i.;ohJ.i pnhl IsIumJ prior 

I ■ tUc mLCtlfi); Llmi.*? 

'■ .Tf ncocln^ raliiuti's j>rfp.iri'»J 

i( J( i ill luilS J l>l Che 

II .■ I lOrN^ bo.trd i;. jl c tti.it 

(• itUol Ilk iiuiiri>>( nr iHton 
1 1 1 u It lo(t . lo the pro J. it 
A* 



l>-26 

Projuct RRAL 
Maiui^omont 

Advlaiory 
Bii.ird Hlniitoti 

Side t^ffcctg 
Kvaludtlon Forn 
h-23 ProcuNH 
Kvtiluiitloit 
Form 

h-2A Sido-IUfuclrt 
I V.I 111. It Inii 
Korm 



Spring 



KotMtlVQ 



Review of 
board 

nliuitcs and 
'jKuiida (i) 

(Comparative 
analyali 

between 
plnnned 
and autual 
iDiplfffluntat Ion 
of iiilvlbory 
boiird. 



Advisory board 
aatabllahtd and 
oparating In 
accordanca with 
nanageaant plan 
vpeclf Icationi. 



lOOX of AdvUory 
board Hlnutea and. 
agenda (v)t 



i 



M i^n.^or^otit Proccs« Evaluation 



I*. wlut tfxtenc was thtt REAL 

priijoci iBpI«Mnted planittfd? 

a. Wcro thi nficciiiary physical 
t i. llltUs avalUbU (fil« 
v.iblnutSi dcttkSi audio* 
visual tquipiMnti furniturQ 

on) ac Mcli of th« 
ihruo projtct sites? 

b. Woru Itarnint cunttrs 
uHtablitfhsd at tacli sitti? ^ 

. ^ crc thkf f.iuilitiea appro- 
i'ci ittf lu terms of upacv . 
liloojclon for Intondod 
..CiiJiMU popglatlon? 
<l. .11 iJuqiijto tranttport.i- 
( ( 111 provided for each 

-.1 iiiii'iit i 

' . '.'l ie kutficivnt cgmmunUy 
r^'iources (coMunlty work 
recruited and 

ii(lii2vd to Btict student 
li' lining objective!!? 
r. i.«'r.- tiidlvidual fblJers 
(•ii.-p>iriid for each student 
111 thu project and do tia-y 

tut (In tliu spdcifli^d 
r». cords? 

..'lift' curricula jd.ii>ied| 
a.ii)pced or utbcrwl^ie dt.-velupcd 
in>l inpleaentcd to mrct 
Inllvldiial l4ed stuiIiMilb 
ni.'uJsk plantf and uxpectac ionajf 



■ r- • ■ >;v«i I u«u t o I r I' \iM J'q r i - 

Prujuut KLAI. HaiiaguHtiiit l*roc(<sH Kviiluiitlun (^ll*liiilmH 

Uiita YiM Evaluation 

Sourca Data GolUcttd Dasign AiisiysU 



l)-21 
ProctfHS 
Evaluation 
Forn 

On-sits Visits 
D-2S 

ProjKut RKAl. 

proposal 

D-20 

Etnployoe 

Interview 

ScliQdiile 

1>-H l.(!,irnini; 

Situ AiinlyniH 

Ko'm 

l>-9 

Crolect Kora 
l>-10 

Skill Uuvolupmunt 

Kec'urd 

1>-11 

l.unrnlnK Scl f 
Asbusununt 

Arcoiintuhil Ity 
Cunt r jet 



Spring and 
Fall 



Fornativs 



Narrttiv«* 
description 
of facilities 
and rtsources 
available to 
staff and 
students at 
vacli site, 



Prri-unt.iKi>^ 

of StudlMltH 

arrlvlnr. on 
Work situs uu 



Tsrgut 
Critsrla 



Saapli 



t imu 



Riltlu of HludcntH 
Co cottiQunliy work 
u i tos 

Ki'Vicw of 

Individual 

folders 



('(MitiMit Hn.ilyslH 
of cnrr Icnl^i 
and stiidrnis* 



Suff Icisnt 
allocation of 
physical faciUtiss 
to aceofliodata staff 
and studanta. 



9UZ of students 
arriving ut work 
bltu on t Isio, 

IQOZ of students 
placed in explanatory 
and luarnlng level 
aocivit ies 

lOOZ of foUers 
reviewed contain 
specified records 



CJurrleula shall be 
cunBistent with 
individual students 
needs I plaiiu and 
expectst Ions . 



loot of project REAL 
site* i,a. Nswarki Glasgow 
and Christiana High 
School's 



Kandom uanple uf ^nZ 
of students at each 
school site 

Ditto Above 



Ditto Above 



H I 

o 
> I 



Ditto Above 



er|c 



/ » 

if i 



r 



Documents Checklist-Project RFAL 



Document 

D 1. EBCE Essential 

Characteristics Checklist 



D 2. EBCE Process Checklist 



D 3. Indemnity Insurance Policy 

D 4. Insurance, Student Transporation 
and Accident Form 

D 5. Employer's Card 

D 6. Employer's Agreement Form 

D 7. Maintenance Visit Record 

D 3, Learning Site Analysis Plan 

D 9. Project Form 

D 10. Skill Development Record 

D 11. Learning Self Assessment 

D L2, Sign-in sign-out Sheet 

D L3. Discipline/Accountability Letter 

D 1-.. Accountability Contract 

D L5, Student Questionnaire 

:> Lh. '.-.'c't.'kly Time Report 

D 1\ Cortif icition Form 

!) I-. '..y;ipt' tunc ios Record 

:) 1 ; t iider.t: Plannin;:; Form 

!' F-'-p 1 .);.'fj r Intorviev Schedulti 

:.' Jl. '."^reer Skills Assessment Program 



Source 

ETS 
ETS 
PD 

S;PD 
CC:E 
E 
. CC 
CC 
LM;S 
S 

s 
s 

3;P 
LM 

S;LM 

S 

S 

E 

CC 



Location 

ETS 
ETS 
CF 

SF'^ 
SF 
SF;EF 
SF 
SF 
SF^'-- 
SFA 

SF 

SF-'^ 
SF-'' 

SF-- 



ERIC 



• ■ ■ ^52- 
Document Source Location 



D 23 • Prpcfis^^E^^ ...„.u_. 

D 24* Side Effects Evaluation Form 

D 25* Advisory Board Minuues 

D 26. Project REAL management plan 

D 27. Staff Job Description 

D 28. Project REAL Proposal 

D 29. Exploration Guide 

D 30. Student Report Forms 



ITS , „. 





ETS 


ETS 


rD 


CI- 


PD 


CF 


PD 


CF 


PD 


ETS;CF 


S;LM 


SFA 


LM 


SF 



Approved by director Project REAL 
February 17, 1977 



-53- 

APPEi^IX A(CONTD) 



Code » Iden tification of Source DoGument 

ETS Educational Testing Service 

PD Project Director £or REi\L 

S Students in Real Project ^ 

CC Comnunlty Coordinator 

LM Learning Manager 

E Employer 

P Parent 
Code = Location 

ETS Educational Testing Service files 

SF School Files i.e. Newark, Christiana, 

or Glasgow High Schools 

CF Central Flle.<5 i.e. Newark School District 

Office 

Documents that are part of each student ^s 
project REAL Folder. 

EF Employer's File 
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APPENDIX B 

Site Name Project REAL. Newark School District 

Respondent Name Dr. Prlmo Toccafondi 

Observer R. G, Wasdvke. Project Evaluator 

Date April 3. 1978 

Implementation S i te Essential Characteristics Checklist 

For each area rate the site on a five-point scale with the anchor points 
on the scale indicated. 

I. EBCE is an Individualized program 

A. Ongoing assessment of student needs, Interests .^nd abilities in Basic 
Skills, Life Skills and Car**er Development 

1 There is no ongoing assessment in two or more of these areas 

s : 

5 Studnet needs, interests and abilities are continually assessed 

B. Participation in assessment 

1 Students play a passive role in the assessment process 

m • 

5 Students play an activce and involved role in the assessment process 

C. Individual negotiation 

I All projects are pre-assigned and not subject to negotiation 

0 : 

5 All projec s allow for negotiation between f^tudnnt and learning 
manager 

r. Integration 

1 There is no formalized, Individual a^sossment and '(^r nccoiini .ibl 1 i t v 

0 : 

Individual assessment and accountability n re Int^^^rnted with 
program learning strato^ies when learning plans are negotiated 

K • Af^rountabl li t\' standards ("a set of learnlnj! and St'b. av i <ir .j 1 expert 1 imv- 
f(^r students as members of the FRTF ' r omnu n i t v ' " i 

1 There .n e few ariv.^u n t abi 1 1 1 y stanriards 

Ar rount ah i 11 tv standards ulve the stwient iMM-^-ssar-.- :M*>;il.iM* 

r o nee t has 1 r program e xp e r t at 1 nns 
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APPENDIX B (Contd) 

TT ■ - l^rr is a Community-Based program 

A. Community input into program planning and operation 
1 No mechanism currently exists 

5 A systematic mechanism exists for procuring and utilizing communiuty 
input 

District career Education Advisory Council 

B. Role of the program advisory board 

1 There is no program advisory board 



5 The program advisory board takes an active role in direction of 
the program by providing program Input 



C. Commuiiity members and student learning 
1 Community members are not Involved In student learning activities 

5 Community members serve as resource instructors and certifiers of 
student learning 

D. Providlon for employer instructor training/development activities 
Not done 1 There are no employer Instructor training/development actltlves 

L • 

t 

5 There are at least four, regularly-scheduled employer instructor 
training /development activlt les 

ITT. EBCE Is an Experience-Rased program and Is built front ho career activities 
of adults 

A. Mode of learning 

1 Students ^-^re Inst ructed in a pass ivt* nr fichool-l ike rmde 

Arroiintabi 1 itv ^^tandardfi kIvp the studpnt nH('pqsnr\' flexibiiitv 

to m€>et b.Tfi 1 r p ro^ram e xpf^'.'t' a 1 1 r^ns 
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ERiC 



APPENDIX B (Contd) 

B. Student activity 

1 Stvidents are assigned activities and schedules 

5 Students have the responsibility for budgeting their time and 
managing their daily activities 

C. Utilization of resources 

1 Secondary resources (textbooks, courses) are given priority 



3 



5 Primary resources (people; institutions, such as libraries and 
museums; events) are given priority 



D. Community learning activities 

1 Adult activities in the community are not utilized in student 
learning 



5 Adult activities in the community serve as the primar>^ context for 
student learning 



F. . Reference population 

1 Adolescent peers and school work are the primary referrenC 



5 Adults in the world of work are the primary referrent 
F. Community learning potential 

1 No analysis is made of the learning potential of the local 
community 

3 Tbere is systematic analysis that enables staff and students to take 
full advantage of the learning potential of the local community 



-57- 



APPENDIX B (Contd) 

TV. EBCE must have its own Identity and must be Comprehensive and Integrated 

A. Program requirements and processes 

1 Regular high school requirement and processes are used to 
determine student learning plans 

n : 

5 EBCE program requirements and processes determine student learning 
plans 

B. Program completion requirements 

1 Program completion requirements are vague, unspecified or not 
differentiated from the regular high schol requirements 

■ • 

5 Program completion requirements are clearly defined, differentiated 
from and consistent with program goals and local requirements 

C. Curriculum 

1 The curriculum structure includes experiences in either one or 
none of the following areas: basic skills, life skills, career 
deve lopment 

'3 : 

5 The curriculum structure includes experiences in all of the above 
areas 

D. Survival competencies 

1 There are no perf ornance-based survival competencies 

a ; 

5 There .ire at least ten performance-based survi /al competencies 
necessarv for coping in life and modern society 

E. I nterrelatedness of curriculum areas and student learning 
1 Disciplines are emphasized separately 

■J • 

Fmphasls ts on i n t: e r r e 1 r. od t:u r r 1 cm lutn .irpns and this Is 
d'^monst r.it bv thf' student Ipnrnini?. ,ift i v i t l os 



ERIC 



^7 
S 
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APPENDIX B (Contd) 



The KRCE program places a major emphasis on the Career Development of students 
A. Types of community learning situations 

1 There are no employer/community learning sites 



4 



5 Provision is made for different types and levels of learning 
situations at employer/community sites 



B. Emphasis at learning sites 

1 Students are paid for their contributions on employer/community 
sites 

0 : 

5 Students are on employer/community sites for learning about careers, 
not earning money 

C. Career Decision Making 



1 Students are not encouraged to improve their career decision- 
making process 

9 

5 Students are required to gather information about themselves 
and the world of work and apply this information in career 
decision making 



D. Reflections on student experiences 

1 There are no requirements towards self-evaluation 

5 Students rire encouraged to reflect on student experiences and 
evaluate their own strengths and weaknesses and progress 



